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The rapid advancement of technology holds great promise for various types of 
users, clients, or service providers. Intelligent robots, whether virtual or physi- 
cal, can simplify the reservation process. With the development of machines and 
processing tools, natural language processing (NLP) and natural language un- 
derstanding (NLU) have emerged to help people comprehend spoken language 
through machines. In order to facilitate seamless human-machine interaction, 
we aim to address customer needs through a chatbot. The objective of this paper 
is to incorporate sentiment analysis techniques with deep learning algorithms to 
cater to customers’ needs during message exchanges. This study aims to create 
an intelligent chatbot to engage customers during their routine operations and 
offer support. In addition, it offers to companies a manner to detect sarcastic 
messages. The proposed chatbot utilizes deep learning techniques to predict 
users’ intentions based on the questions asked and provide a helpful and con- 
venient answer. A new chatbot for the customer is presented to overcome with 
challenges related to a wrong statement like sarcastic one and feedback towards 


user messages. A comparison between deep and transfer learning gives a new 
insight to include sentiments and sarcasm detection in the conversion process. 
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1. INTRODUCTION 

The evolving technologies in artificial intelligence are considered the primary helpful tool in human 
life [I]. The emergence of intelligent systems and their flexibility has facilitated their incorporation into web- 
sites and mobile applications. Human-machine interaction made a huge splash recently, especially during and 
after the COVID-19 pandemic, which introduced virtual and physical bots [2]. To prevent any direct commu- 
nication or even travel to book a restaurant or flight, usually people or clients must give a call or go directly 
to finish the job. Evolutionary techniques, such as natural language processing (NLP) and deep learning tech- 
niques, make it easier in a manner that makes machines ensure the communication operation. Virtual assistants 
have been known for many years through some applications such as Apple Siri or Amazon Alexa, and others 
make good help for users [3], [4]. Indeed, chatbots are considered the most suitable application to facilitate 
machine and human communication. The revolution of social media, such as Web 3.0 and Web 4.0, spread 


Journal homepage: http://beei.org 


Bulletin of Electr Eng & Inf ISSN: 2302-9285 o 1753 


the utilization of robot assistants, especially in commercial pages that require service the whole time [5], [6]. 
Moreover, the spread of information and the quantity of data with the evolution of resources given by cloud 
computing through their services made the development much easier to satisfy the client’s demands [7], [8]. 
Nevertheless, in traditional communication, the user calls for service by phone or travels to some location, 
which may waste time. Human-to-human communication is, in fact, related to work time, which is not covered 
the whole day, and people may get tired from taking calls. To solve this issue, AI bots are represented as a 
suitable solution. Personal assistants could enhance and facilitate transactions, and it would help to propose a 
solution from the internet for an alternative solution in a reasonable time. The advancement of natural language 
treatment is the trend in the whole market, as shown by Bard of Google or ChatGPT for OpenAI [9], [10]. How- 
ever, these solutions are not the best for personal websites and private companies. Any company should try to 
use its receptionist AI bots to respond to clients’ requests. Moreover, processing natural language is a challeng- 
ing problem due to the significance and meaning of the words used in each situation (the same word has many 
definitions). To study this problem, the most appropriate solution is to use AI solutions such as ontologies, 
semantic-based solutions, and others [11], [12]. However, these methods are not good enough to respond to 
the client’s requirements quickly and make an accurate response due to the complexity of the treatment. Deep 
learning and transfer learning have leaped to understand natural language [13], [14]. One more critical prob- 
lem related to misunderstanding messages such as related to ironic or sarcastic ones as used in social media 
messages. Behavioural profile is messing in previous chatbots, this problem can detect the sequence chain 
of messages which link it to the user’s sentiment. In the literature, over the past few years, human-machine 
interaction has evolved with the advancements in NLP and deep learning techniques. Actually, several works 
have been conducted to develop virtual or physical bots using robots or augmented reality avatars. Chatbots 
have been widely explored in various domains, including tourism, healthcare, education, and customer service 
(15}-(21]. Specifically, in the context of customer service, Ngai et al. proposed a chatbot-based solution 
based on a dedicated knowledge-based design framework. The framework incorporates customer knowledge 
management (CKM) and utilizes a web crawler to collect data from the internet, thus improving the chatbot’s 
knowledge base. Tran et al. investigated the impact of chatbots on consumer behavior in different retail 
sectors, with a primary focus on the fashion and telecom industries. They combined a VADER lexicon-based 
classifier with a Naive Bayes classical machine learning model to examine customer sentiment towards chatbots 
and online human agents, particularly on Twitter. Chung et al. analyzed customer data related to chatbots, 
particularly in the context of luxury fashion retail brands. They employed five different models to measure 
customer perceptions of chatbot interactions, entertainment value, customization, and problem-solving. Their 
study provided insights into how chatbots influence luxury customer feedback and satisfaction. Sperli 
introduced a framework designed to assist tourists during their journeys. This framework integrates intangible 
and tangible cultural objects into a unified data model and utilizes a seq2seq model to generate answers. It 
also offers information about events or suggests visit paths. Dharani et al. addressed the challenges faced 
by passengers in public transportation, particularly when navigating unfamiliar locations. They developed an 
interactive chatbot that provides information about buses and their operating schedules, simplifying the process 
for passengers to utilize and communicate at any time or location. The chatbot utilizes long-short term mem- 
ory (LSTM) for text classification and selects responses from a database of previous answers. Oguntosin and 
Olomo created a chatbot for Covenant University shopping mall, aiming to provide intelligent, accurate, 
and real-time conversations with students. The chatbot allows students to communicate and inquire about spe- 
cific items they want to purchase online. It is accessible through different devices, providing 24-hour online 
service. They utilized the Seq2seq model for feature extraction and sequence output. Xu et al. developed a 
conversational system for customer support using a sequence-to-sequence model with an encoder and decoder 
based on LSTM neural networks. The model was trained on a Twitter conversation dataset, and upon receiving 
an input request, it generates a response. 


However, all the previous mentioned works does not consider some issue related to person profile 
can change the conversation from client to another which represented as critical issue in such application. In 
addition, incorporating sentiment in conversation it is in fact big challenges when we talk about the nature of 
sentences and messages. Obviously, many users exchange messages with hummer manner especially in such 
application for fun as social media which could lead to misunderstanding during conversation. These sarcastic 
and ironic messages challenges are the difficult to detect using previous chatbot. The paper aims to solve the 
problem by proposing an AI bot model using deep learning techniques for intent recognition and classification. 
With retrieval information, the chatbot could help the user get an accurate answer in a reasonable time. Another 
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issue related to customer communication, especially in order operations, led to the cancellation of orders, which 
may reduce the company’s efficacy and reputation. To solve the mentioned issue, our solution is to construct a 
generative response using sentiment analysis to ensure a good understanding of the customers’? mood through 
a question/answer application to gain the client’s trust. Most of presented works does not focus on sentiment 
during conversation. One more critical matter related to sarcastic or ironic message detection which is a big 
challenge, which could lead the conversation accurately and satisfy both clients and market. The proposed 
framework has the following benefits: 

— A sarcastic and ironic message detection during conversation. 

— Feedback generator using user historical conversation and social media dataset. 

— Sentiment analysis to increase answer precision. 

— Comparison of deep learning and transfer learning for sentiment analysis and sarcastic detection chatbot. 

— Voice and text-based answer chatbot with multilingual option (English, Arabic, and French). 

The present paper is organized as follows: section 2 describes our proposed framework with the used 

method. Section 3 provides some discussion about the obtained results. Finally, section 4 concludes this paper. 


2. PROPOSED METHOD 

The evolution of artificial intelligence techniques has led to the development of personal assistants, 
which are becoming increasingly popular in the form of virtual and physical question-answering systems. 
ChatGPT and Bard are examples of systems designed to retrieve information from vast knowledge banks, 
but private companies often prefer to have their own customized solutions. Communication plays a crucial 
role for companies, particularly those with customer services, and it is essential to build a robust application 
capable of handling various user queries beyond just frequently asked questions. Language processing can 
be complex, even in human-to-human communication, so automating the task with machines presents its own 
set of challenges. Among the challenges resolved in this paper is the problem of understanding sarcastic and 
ironic messages that are often noisy for company. One more critical thing is related to feedback that might 
enhance both the company and customer satisfaction in the future. Whereas sentiment is interesting in such 
use, studying every statement is to difficult using a machine. The present solution presented in the following 
framework (see Figure [ip. 
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Figure 1. Overview of chatbot framework for customer satisfaction 


The proposed framework for chatbot relies on a trained model to provide responses to client inquiries. 
Retrieving the appropriate response from a vast dataset poses a significant challenge. In this paper, we propose 
a chatbot that leverages multiple deep learning models to accurately select the correct answer for user queries. 
Additionally, our chatbot has the capability to respond in three different languages and can also provide speech- 
based responses to cater to the needs of visually impaired individuals. In our proposed solution, the chatbot 
takes the user’s sentiment into account in order to deliver personalized and satisfactory responses, ultimately 
contributing to increased profitability and reputation for the company. Moreover, it helps to detect sarcastic 
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messages since are disturbing at the company level. 


2.1. Data pre-processing and normalization 

Pre-processing is a crucial step in constructing models using machine learning or deep learning tech- 
niques. Its main objective is to make the data more manageable and enhance the model’s accuracy for classifi- 
cation. The quality of the data is paramount in determining the effectiveness of this step. The following steps 
are performed during each model construction phase: 

— Removal of stop words, punctuation, and undesirable symbols. 
— Tokenization, stemming, and one-hot encoding. 
— Reducing word variation by converting all words to lowercase. 

Therefore, our data pre-processing methods aim to represent each sequence with an integer represen- 
tation of the same length as the vocabulary size (number of unique words) in the dataset. This vectorization 
process simplifies the training and building of the NLP model. In this chatbot, we utilize an open-source Kaggle 
dataset that includes a collection of 27 intents grouped into 11 categories related to the *customer support” 
domain. These intents were extracted from Bitext’s 20 domain-specific datasets while retaining intents that 
are relevant across different domains. The dataset provides information on intents, categories, and languages. 
Also we used another sarcastic dataset [27], consists of 28,619 tweets tagged with 0 for not sarcastic and 1 for 
sarcastic. 


2.2. Chatbot customer assistance process 
In this subsection, we introduce the used models and the whole process used in the framework espe- 
cially sentiment analysis and sarcasm detection. 


2.2.1. Training models 

Our proposal utilizes two types of deep learning and transfer learning. The first two models employed 
are LSTM and Glove_LSTM, which are unsupervised learning algorithms used for word representation [28]. 
LSTM is a recurrent neural network that requires multiple steps to reduce errors and improve the accuracy of 
question responses [29]. Initially, we utilize the pre-constructed one-hot encoded sequence to train our intent 
classification prediction model. Creating an accurate model is crucial, especially for deep learning models. To 
achieve this, we need to determine the optimal configuration, including the number of LSTM cells, layers, and 
activation functions. Finally, we test and validate the model using predictions. The LSTM model addresses 
these challenges by learning when to forget and when to utilize gates (similar to basic neural network gates, 
but with three gates: input, forget, and output gates refer to Figure[2). The input gate determines which values 
should be stored in memory, the forget gate determines which data should be discarded, and the output gate 
determines the state modification to compute the output for the current timestamp. The architecture of an 
LSTM cell (see Figure[2) can be described as (1) to (5) (30): 


Input gate : i, = o(w;.[he_-1, £e] + bi) (1) 

Forgot gate: fi = o(wy.[he_1, xt] + bf) (2) 

Output gate : 0, = o (wo.[ht—1, ve] + bfo) (3) 

Cell state: ci = ft X G1 + is x tanh(we.[he-1, £t] + be) (4) 
Cell output : hy = ot x tanh(c) (5) 


Where w, represents the weight for the respective gate(x) neurons, h¿——1 is an output of the previous LSTM 
block, x+ is input at the current timestamp, and b, are the biases for the respective gates(x). 

The third model, bidirectional encoder representations from transformers (BERT), is a pre-trained 
language model that utilizes transfer learning. This approach is gaining widespread recognition in the field of 
NLP and is gradually becoming an industry standard. BERT stands out for its ability to capture and extract 
contextual meaning within phrases or texts. Unlike traditional word embedding models, BERT considers the 
surrounding words and context to determine the numerical representation of a word or token during the concept 
embedding process. This contextual understanding enhances the model’s ability to comprehend the syntax and 
semantics of a text [31]. 
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Figure 2. Inter LSTM cell architecture 


In order to respond to the users’ questions, the proposed customer assistance comprises a set of steps 
illustrated in the subsequent flowchart (see Figure[3). Our chatbot is designed as an information retrieval system 
to provide accurate responses. The steps involved in our solution are depicted in Figure B] 
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Figure 3. Chatbot customer assistance process 


— Data preparation: this step refers to data enrichment in our framework, at this stage we apply data en- 
richment towards existed data to add specific information using techniques for the purpose of enhancing 
it. The first method is tf-idf along with WordNet ontology to annotate texts in dataset [32]. We incor- 
porate sentiment labelling using one-hot encoding sequences [33]. This enables the model to analyze 
the input and categorize the sentiment into three classes: positive, negative, or neutral, enhancing the 
understanding of the conveyed sentiment in the text. The same thing for sarcasm labeling using social 
media dataset. 

— Data preprocessing: refers to steps explained in subsection [2.1] for the purpose of coding data (word 
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embedding) to feed them to DL and TL models. 

— Prepare training model: to prepare the training model for classifying intentions based on the previously 
explained dataset, this step is crucial. The employed deep learning techniques, namely BiLSTM and 
Glove_LSTM, rely on specific settings to create the best model. We define various parameters, including 
dropout rate, number of epochs, learning rate, batch size, optimizer, and loss function. In case the model 
fails to deliver satisfactory or accurate results, we iterate through this step, experimenting with different 
parameter combinations until we enhance evaluation metrics such as F1-score, recall, and accuracy. 

— Sentiment analysis: after configuring the settings and performing intent classification, the next step in- 
volves annotating the texts in the dataset using WordNet. Additionally, we utilize a dataset that has been 
labeled with positive, negative, and neutral sentiments. To accomplish this, we employ both BiLSTM 
and Glove _LSTM models. Subsequently, we can either save the annotated texts for general messages or 
disregard them as needed. 

— Sarcasm detection: deep learning techniques are instrumental in detecting patterns in text. It is crucial 
to identify the direct meaning of a message, making sarcasm detection essential for customer chatbots to 
instil trust and save time. In our framework, we trained our model to distinguish between sarcastic and 
non-sarcastic messages. These messages resemble those commonly used on social media for humour or 
to annoy someone, which is not suitable for this context. The BiLSTM model was trained using a dataset 
to create a capability for identifying such messages. Our framework generates a general response in such 
situations, offering a rephrased response or suggesting a different question. 


Towards the conclusion, once we have minimized the model’s errors and improved its accuracy and 
precision, we proceed to save the trained model. Subsequently, we can integrate it into our chatbot. Further- 
more, our framework has the capability to enrich its dataset through surveys and feedback gathered from users. 
Then we combine both models to obtain a model able to detect sarcasm and handle sentiment as well. The next 
(see Table[I) explains the used configurations train the used models BiLSTM and Glove _LSTM. 


Table 1. Hyperparameters settings 


Parameters Values 
BiLSTM output size 20 

Dropout 0.3 

Epoch 20 

Learning rate 0.001 

Batch size 128 
Validation split 0.2 

Loss function Cross-entropy 
Optimizer 0.90 


2.3. Evaluation metrics 

Evaluating models requires calculating some measures after training and validation to see if they 
are ready to use. Performance evaluation included accuracy, precision, recall, and Fl-score [34], [35]. This 
subsection describes evaluation metrics: TP, TN refers to true positive and negative, whereas FP, FN refers to 


false positive and negative. Precision, recall, and Fl-score, based on the parameters provided, are expressed in 
(6) to (9): 


P TP+TN i 
racy = 
COON = TPHFEFPHTN4FN 
TP 
Precision = 7 
recision TPL FP (7) 
TP 
Recall = 8 
eca = TP FN (8) 


Hees 2 x (precision x recall) 


(9) 


precision + recall 
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3. RESULTS AND DISCUSSION 

This section presents some experimental results which are obtained from used models, then we ana- 
lyze the obtained results with some discussion related to proposed framework for customer chatbot purposes. 
As mentioned in the previous section, this paper utilizes deep learning models, specifically BiLSTM and 
Glove_LSTM, to predict user intent and address their concerns. In addition to these models, we also employed 
transfer learning using the BERT model. To compare the performance of these models, in our experiments we 
have used two ideas: i) the first one we just implies intent classification using sentiment with three models and 
ii) where the second consists of combining two models for sentiment analysis and sarcasm detection only with 
BiLSTM and Glove_LSTM. Our obtained results presented in the following see Table |2| Figure [4] explains 
the confusion matrix of the proposed framework (Figure /4]left one) after constructing the model for intention 
classification with sentiment. From this figure, the model provides a good solution suitable for any intention 
and can predict the right intention from the user question. 


Table 2. The performance results 


Intent classification Sentiment and Sarcasm detection 
Metric BiLSTM Glove LSTM BERT BiLSTM Glove LSTM 
Accuracy 0.90 0.94 0.997 0.92 0.96 
Recall 0.90 0.96 0.99 0.70 0.77 
Precision 0.94 0.99 0.99 0.90 0.93 
Fl-score 0.90 0.98 0.99 0.79 0.85 
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Figure 4. Confusion matrix and evaluation performance results 


In this paper, we present a customer assistant bot that assists users with their questions, considering 
their sentiments. As discussed in previous sections, our chatbot is constructed using three different models. 
As shown in Table [2| the BERT model performs well across various metrics. This can be attributed to its 
pre-training on a large dataset, although fine-tuning the model settings was necessary to achieve these results. 
In the case of the deep learning models, BiLSTM and Glove_LSTM, we observe different outcomes compared 
to the BERT model because these models were built from scratch. BiLSTM, which is based on a recurrent 
neural network, is well-suited for this problem as it can comprehend the context and semantics of sentences 
and documents, leading to reliable Fl-score results. On the other hand, Glove_LSTM utilizes global vectors to 
represent and encode words, aiding in the processing step. This technique also helps in reducing the number of 
words, which significantly impacts sentiment detection from user queries. To measure the loss value in these 
models, we employ a categorical cross-entropy function, which is commonly recommended for classification 
problems. Furthermore, some of these models require addressing issues of underfitting and overfitting. To 
mitigate these problems, we introduced a different activation function in the last layer, specifically the dense 
layer of the model. For the second method, which provides a fusion between two BiLSTMs (Glove_LSTM 
for comparison) models for both sentiment and sarcasm, we can observe from Table |2| (presented in Figure 
[4Jas BiLSTM-fusion and Glove_LSTM-fusion) that it yields good results in accuracy. However, the Fl-score 
decreases due to the occasional confusion between sentiment and sarcastic messages, which can be semantically 
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similar in some instances. To address this issue, we can consider combining multiple models to improve the 
overall performance. Overall, our approach demonstrates the effectiveness of utilizing various models and 
techniques to construct a customer assistant bot that takes user sentiments into account and provides accurate 
responses. Adding some experiments from social media to detect sarcastic messages will help to ensure a good 
quality of responses. 


4. CONCLUSION 

In this paper, we have presented a framework that can handle the process of exchanging messages with 
the clients in automatic manner. The proposed framework able to respond to clients taking into account the 
sentiment and sarcasm in messages. As we have seen deep learning approach that addresses the challenge of in- 
formation retrieval for answering user queries on commercial websites more suitable. NLP poses complexities, 
and finding appropriate responses can be a daunting task. However, advancements in AI techniques, particu- 
larly deep learning and transfer learning, have played a significant role in assisting companies in developing 
applications that provide support anytime and anywhere. 

In our study, we focused on incorporating user sentiments including sarcasm detection into our chatbot 
to ensure meaningful responses. By extracting sentiments from user queries, we can select the most suitable 
response. Moreover, our chatbot offers easy accessibility through text-based input or voice messages, enhanc- 
ing the user experience. Additionally, it is designed to handle client questions in multiple languages, further 
expanding its usability. Identifying the correct question intention remains a challenge, but deep learning and 
transfer learning techniques have proven to be efficient and effective in this regard. Our paper compared 
several techniques for both expirements only sentiment and both sentiment and sarcasm, including BiLSTM, 
Glove_LSTM, and BERT, with promising results in terms of evaluation metrics. Notably, BERT, with its pre- 
trained model on a large dataset, outperformed the other models. Yet, the fusion of two models is considered 
a big challenge as we have seen in the previous section due the nature and ambiguities of concepts between 
sarcasm and sentiment. 


For future work, we aim to incorporate additional models, particularly those involving sentiment anal- 
ysis with transfer learning, to further enhance our chatbot’s capabilities. Additionally, we plan to explore 
fine-tuning approaches to reduce training time, a crucial consideration in natural language processing tasks. 
These endeavors will contribute to the continuous improvement and advancement of our chatbot application. 


REFERENCES 


[1] K. Einola and V. Khoreva, ’’Best friend or broken tool? Exploring the co-existence of humans and artificial intelligence in the 
workplace ecosystem,” Human Resource Management, vol. 62, no. 1, pp. 117-135, 2023, doi: 10.1002/hrm.22147. 

[2] N.T.T. Van etal., “The role of human-machine interactive devices for post-COVID-19 innovative sustainable tourism in Ho Chi 
Minh City, Vietnam,” Sustainability, vol. 12, no. 22, p. 9523, 2020, doi: 10.3390/su12229523. 

[3] T. M. Brill, L. Munoz, and R. J. Miller, Siri, Alexa, and other digital assistants: a study of customer satisfaction 
with artificial intelligence applications,’ Journal of Marketing Management, vol. 35, no. 15-16, pp. 1401-1436, 2019, doi: 
10.1080/0267257X.2019.1687571. 

[4] K. Sharma, D. Bahal, A. Sharma, A. Garg, and N. Verma, ”ARA-A Voice Assistant for Disabled Personalities,” International 
Journal of Engineering Applied Sciences and Technology, vol. 7, no. 1, pp. 106-109, 2022. 

[5] E. Mbunge and B. Muchemwa, ”Towards emotive sensory Web in virtual health care: Trends, technologies, challenges and ethical 
issues,” Sensors International, vol. 3, p. 100134, 2022, doi: 10.1016/j.sintl.2021.100134. 

[6] R. Gurunath and D. Samanta, ”A novel approach for semantic web application in online education based on steganogra- 
phy,” International Journal of Web-Based Learning and Teaching Technologies (IJWLTT), vol. 17, no. 4, pp. 1-13, 2022, doi: 
10.4018/IJWLTT.285569. 

[7] A. Merizig, O. Kazar, and M. L. Sanchez, ”A multi-agent system approach for service deployment in the cloud,” International 
Journal of Communication Networks and Distributed Systems, vol. 23, no. 1, pp. 69-92, 2019, doi: 10.1504/IJCNDS.2019.100642. 

[8] A. Merizig, T. Bendahmane, S. Merzoug, and O. Kazar, ”’ Machine learning approach for energy consumption prediction in datacen- 
ters,’ in IEEE 2nd International Conference on Mathematics and Information Technology (ICMIT), Feb. 2020, pp. 142-148, doi: 
10.1109/ICMIT47780.2020.9046987. 

[9] A. Tlili et al., ”° What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education,’ Smart Learning 
Environments, vol. 10, no. 1, p. 15, 2023, doi: 10.1186/s40561-023-00237-x. 

[10] R. Santhosh, M. Abinaya, V. Anusuya, and D. Gowthami, ”ChatGPT: Opportunities, Features and Future Prospects,” in 
IEEE 7th International Conference on Trends in Electronics and Informatics (ICOEI), Apr. 2023, pp. 1614-1622, doi: 
10.1109/ICOEIS6765.2023.10125747. 

[11] P. K. Adhikary, R. Manna, S. R. Laskar, and P. Pakray, ’Ontology-based healthcare hierarchy towards chatbot,” in Computational 
Intelligence in Communications and Business Analytics: 4th International Conference, CICBA 2022, Jan. 2022, pp. 326-335, Cham: 
Springer, doi: 10.1007/978-3-03 1-10766-5_26. 


Empowering customer satisfaction chatbot using deep learning and sentiment analysis (Abdelhak Merizig) 


1760 m) ISSN: 2302-9285 


[12] L. Shi, K. Zhang, and W. Rong, ”’Query-Response Interactions by Multi-tasks in Semantic Search for Chatbot Candidate Retrieval,” 
arXiv, 2022, doi: 10.48550/arXiv.2208.11018. 

[13] S. Niu, Y. Liu, J. Wang, and H. Song, ”A decade survey of transfer learning (2010-2020), IEEE Transactions on Artificial Intelli- 
gence, vol. 1, no. 2, pp. 151-166, 2020, doi: 10.1109/TAI.2021.3054609. 

[14] D. W. Otter, J. R. Medina, and J. K. Kalita, ”A survey of the usages of deep learning for natural language processing,” IEEE 
transactions on neural networks and learning systems, vol. 32, no. 2, pp. 604—624, 2020, doi: 10.1109/TNNLS.2020.2979670. 

[15] G. Sperli, ”A cultural heritage framework using a Deep Learning based Chatbot for supporting tourist journey,’ Expert Systems 
with Applications, vol. 183, p. 115277, 2021, doi: 10.1016/j.eswa.2021.115277. 

[16] C. Miura, S. Chen, S. Saiki, M. Nakamura, and K. Yasuda, ’’Assisting personalized healthcare of elderly people: Developing a 
rule-based virtual caregiver system using mobile chatbot,” Sensors, vol. 22, no. 10, p. 3829, 2022, doi: 10.3390/s22103829. 

[17] A. Mendon, M. Patil, Y. Gupta, V. Kadakia, and H. Doshi, ” Automated Healthcare System Using AI Based Chatbot. In Intelligent 
Computing and Networking,” Proceedings of IC-ICN, 2022, pp. 191—205, doi: 10.1007/978-98 1-99-0071-8_15. 

[18] E.W. Ngai, M. C. Lee, M. Luo, P. S. Chan, and T. Liang, ”An intelligent knowledge-based chatbot for customer service,” Electronic 
Commerce Research and Applications, vol. 50, p. 101098, 2021, doi: 10.1016/j.elerap.2021.101098. 

[19] A.D. Tran, J. I. Pallant, and L. W. Johnson, ”Exploring the impact of chatbots on consumer sentiment and expectations in retail,” 
Journal of Retailing and Consumer Services, vol. 63, p. 102718, 2021, doi: 10.1016/j.jretconser.2021.102718. 

[20] N. Belhaj, A. Hamdan, N. E. H. Chaoui, H. Chaoui, and M. El Bekkali, ’Engaging students to fill surveys using chatbots: Univer- 
sity case study, Indonesian Journalof Electrical Engineering and Computer Science, vol. 24, no. 1, pp. 473-483, Oct. 2021, doi: 
10.1159 lAjeecs.v24.i1.pp473-483. 

[21] V. Bidve, A. Virkar, P. Raut, and S. Velapurkar, ”°NOVA-a virtual nursing assistant,’ Indonesian Journal of Electrical Engineering 
and Computer Science, vol. 30, no. 1, pp. 307-315, 2023, doi: 10.1159 1/ijeecs.v30.i1._pp307-315. 

[22] M. Chung, E. Ko, H. Joung, and S. J. Kim, ”Chatbot e-service and customer satisfaction regarding luxury brands,” Journal of 
Business Research, vol. 117, pp. 587-595, 2020, doi: 10.1016/j.jbusres.2018.10.004. 

[23] M. Dharani, J. V. S. L. Jyostna, E. Sucharitha, R. Likitha, and S. Manne, “Interactive transport enquiry with AI chatbot,” In 2020 
4th International Conference on Intelligent Computing and Control Systems (ICICCS), Madurai, India, 2020, pp. 1271-1276, doi: 
10.1109/ICICCS48265.2020.9 120905. 

[24] V. Oguntosin and A. Olomo, ’*Development of an e-commerce chatbot for a university shopping mall,’ Applied Computational 
Intelligence and Soft Computing, pp. 1-14, 2021, doi: 10.1155/2021/6630326. 

[25] A. Xu, Z. Liu, Y. Guo, V. Sinha, and R. Akkiraju, ”A new chatbot for customer service on social media,” in Proceedings of the 
2017 CHI conference on human factors in computing systems, May 2017, pp. 3506-3510, doi: 10.1145/3025453.3025496. 

[26] Kaggle, » Training Dataset for  Chatbots/Virtual Assistants,” Kaggle, 2021. [Online]. Available: 
https://www.kaggle.com/datasets/bitext/training-dataset-for-chatbotsvirtual-assistants. (accessed: Mar. 20, 2023). 

[27] R. Misra and A. Prahal, ”Sarcasm Detection using News Headlines Dataset” AI Open (2023). [Online]. Available: 
https://www.kaggle.com/datasets/rmisra/news-headlines-dataset-for-sarcasm-detection (accessed: Jul. 15, 2023). 

[28] J. Pennington, R. Socher, and C. D. Manning, Glove: Global vectors for word representation,” in Proceedings of the 2014 
conference on empirical methods in natural language processing (EMNLP), Oct. 2014, pp. 1532-1543, doi: 10.3115/v1/D14-1162. 

[29] Z. Wu, W. Zhao, and Y. Lv, ”An ensemble LSTM-based AQI forecasting model with decomposition-reconstruction technique via 
CEEMDAN and fuzzy entropy,” Air Quality, Atmosphere & Health, vol. 15, no. 12, pp. 2299-2311, 2022, doi: 10.1007/s11869- 
022-01252-6. 

[30] K. Smagulova and A. P. James, ”A survey on LSTM memristive neural network architectures and applications,” The European 
Physical Journal Special Topics, vol. 228, no. 10, pp. 2313-2324, 2019, doi: 10.1140/epjst/e2019-900046-x. 

[31] S. Kula, R. Kozik, M. Choras, ’*Implementation of the BERT-derived architectures to tackle disinformation challenges,” Neural 
Computing and Applications, pp. 1-13, 2021, doi: 10.1007/s0052 1-02 1-06276-0. 

[32] A. Merizig, H. Saouli, M. L. Sanchez, O. Kazar, and A. N. Benharkat, ” An Extended Data as a Service Description Model for Ensur- 
ing Cloud Platform Portability,” in Ezziyyani, M. (eds) Advanced Intelligent Systems for Sustainable Development (AI2SD’2018). 
AI2SD 2018. Advances in Intelligent Systems and Computing, vol. 915, 2019, Springer, doi: 10.1007/978-3-030-11928-7_67. 

[33] M. K. Dahouda and I. Joe, ”A deep-learned embedding technique for categorical features encoding,” IEEE Access, vol. 9, pp. 
114381-114391, 2021, doi: 10.1109/ACCESS.2021.3104357. 

[34] V. Moscato, A. Picariello, and G. Sperli, ” A benchmark of machine learning approaches for credit score prediction,” Expert Systems 
with Applications, vol. 165, p. 113986, 2021, doi: 10.1016/j.eswa.2020.113986. 

[35] I. Remadna, L. S. Terrissa, Z. Al Masry, and N. Zerhouni, ”’RUL Prediction Using a Fusion of Attention-Based Convolutional Vari- 
ational AutoEncoder and Ensemble Learning Classifier,’ JEEE Transactions on Reliability, 2022, doi: 10.1109/TR.2022.3190639. 


BIOGRAPHIES OF AUTHORS 


Abdelhak Merizig © f4 obtained his Ph.D. degree by 2013 from Mohamed Khider University, 
Biskra, Algeria, he is working on an artificial intelligence field. He is now an assistant professor at the 
Department of Computer Science Biskra University. Also, he is a member of LINFI Laboratory at the 
same University. He is a member of the scientific committee in several international conferences and 
act reviewer in different journals. His research interests include agriculture 4.0, multi-agent systems, 
human machine interaction, cloud computing, and internet of things. He can be contacted at email: 
a.merizig @univ-biskra.dz. 


Bulletin of Electr Eng & Inf, Vol. 13, No. 3, June 2024: 1752-1761 


Bulletin of Electr Eng & Inf ISSN: 2302-9285 o 1761 


Houcine Belouaar SEJAS] is an associate professor at the Department of Computer Sciences, 
University of Biskra, Algeria. He obtained the engineering diploma in 1996 from Annaba University, 
Algeria, obtained his magister in computer science in networks and multimedia information systems 
in 2011 from Ouargla University, Algeria and his Ph.D. degree in 2018 from Biskra University, 
Algeria. He is a teacher in the Department of Computer Science of Biskra University. Currently, he 
is an associate professor since 2022, he is currently working on Web services and fuzzy logic. He 
is interested in intelligent environment, internet of things, cloud computing, and multiagent systems. 
He can be contacted at email: houcine.belouaar @univ-biskra.dz. 


Mohamed Mghezzi Bakhouche [OE] E[S] obtained his Bachelor degree in 2021 and the Master 
degree in 2023 from Biskra University, Algeria. Currently, he is working on Human Machine Inter- 
action. He is interested in artificial intelligence, natural language processing, and deep learning. He 
can be contacted at email: mohamedmghezzi2 @ gmail.com. 


Professor Okba Kazar obtained a state engineer’s diploma and master’s and doctoral 
degrees from the University of Constantine (field of computer science and artificial intelligence). He 
has published more than 400 papers in international journals and communications at international 
conferences. He participated as a chair and session chair in international conferences. He supervised 
more than 40 PhD and 100 master’s projects. He has published three books: “The Artificial Intelli- 
gence Handbook,” “Big Data Security,” and “AI with the Practice.” Moreover, he has published more 
than 14 book chapters. His main research area is artificial intelligence, he is interested in multi-agent 
systems and their applications, PHM in medical and industrial fields, enterprise resource planning 
(ERP), advanced information systems, robotics, web services, semantic web, big data, IoT and cloud 
computing. He held the rank of visiting professor at many universities in Europe, especially in France 
and Spain. He was a professor in the Department of Computer Science at the University of Biskra, 
where he contributed to its founding. He also founded and was director of the Smart Computer Sci- 
ence Laboratory at the University of Biskra. He was a visiting professor at the United Arab Emirates 
University (UAE, Abu Dhabi). He currently works at the University of Sharjah, Kalba branch, in the 
Emirate of Sharjah. He can be contacted at email: OKazar@sharjah.ac.ae. 


Empowering customer satisfaction chatbot using deep learning and sentiment analysis (Abdelhak Merizig) 


